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Response to Amendment and Arguments 

1 . Applicant's amendment filed May 16, 2007, has been entered and made of record. 

2. The rejection of claims 18-26 under 35 U.S.C. 101 is withdrawn as the Applicant 
amended the claims to make them statutory. 

3. The objection of claims 30-32 is withdrawn because the Applicant amended the claims to 
overcome the objection. 

.4. Applicant's arguments, see page 8 of the Remarks, filed 05/16/2007, with respect to the 
rejection(s) of claim(s) 1-11, 16-20 and 25-29 under 35 U.S.C. 102(e) as being anticipated by 
U.S. Patent No. 6,879,709 to Tian ("Tian") have been fully considered and are persuasive. 
Therefore, the rejection has been withdrawn. However, upon further consideration, a new 
ground(s) of rejection is made in view of 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent No. 6,879,709 to Tian ("Tian") because as indicated by Tian, it is a prior art (column 12, 
lines 18-20) that one of the ordinary skill in the art can compute transformation parameters 
(compute the location of the salient landmarks/points during the variable/change of 
pose/expression) (column 12, lines 18-25) that represent a transformation from the deformable 
model to the positions (variability/change of shape properties of pose/expression model) (column 
9, line 65 to column 10, line 14) of the four points (FIG. 5B; FIG. 9, element 905; and column 
12, lines 18-25). Thus it would have been obvious for one of the ordinary skill in the art to 
modify Tian's method in estimating position to compute transformation parameters of 
deformable model to the positions of the four points to better determine facial expression 
because characteristic points able to normalize and maintain visual appearance of a human face 
(column 12, lines 40-55). This would improve processing and therefore, it would have been 
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obvious to one of the ordinary skill in the art to modify Tian to implement the discussed 
limitation. 

The Examiner believes that all the arguments of the Applicant have been properly 
addressed and explained. Thus, the rejections of all of the claims are maintained. 

Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 1-29 are rejected under 35 U.S.C. 103(a) as being unpatentable over Tian et al. 
U.S. Patent No. 6,879,709. 

Regarding claim 1 , Tian teaches a medium bearing a deformable model (detect an 
expression of the face by using model to detect the changes of facial images by the process of 
normalization since normalization is known to compensate changes and variance of position, 
pose, scale and illumination) (abstract; column 9, lines 20-25; FIG. 13; and column 1, line 63 to 
column 2, line 4) configured to enable a machine to estimate positions of four points (detect 
position of six points) (column 8, line 29-40) defined by X and Y coordinates (column 13, lines 
1-4), each of the points representing a facial element position (column 13, lines 5-15) in a digital 
image (abstract, 2 nd line). 

As indicated by Tian, it is a prior art (column 12, lines 18-20) that one of the ordinary 
skill in the art can compute transformation parameters (compute the location of the salient 
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landmarks/points) (column 12, lines 18-25) that represent a transformation from the deformable 
model to the positions (variability/change of shape properties of pose/expression model) (column 
9, line 65 to column 10, line 14) of the four points (FIG. 5B; FIG. 9, element 905; and column 
12, lines 18-25). Thus it would have been obvious for one of the ordinary skill in the art to 
modify Tian's method in estimating position to compute transformation parameters of 
deformable model to the positions of the four points to better determine facial expression 
because characteristic points able to normalize and maintain visual appearance of a human face 
(column 12, lines 40-55). This would improve processing and therefore, it would have been 
obvious to one of the ordinary skill in the art to modify Tian to implement the discussed 
limitation. 

For claim 2, Tian also teaches the medium bearing a deformable model in which the four 
points include a first point designating a center of a left eye (column 13, line 47). 

Regarding claim 3, Tian further teaches the medium bearing a deformable model in 
which four points further include a second point designating a center of a right eye (column 13, 
lines 47-48). 

Referring to claim 4, Tian discloses the medium bearing a deformable model in which the 
four points further include a third point designating a left corner of the mouth (column 9, line 
27). 

Referring to claim 5, Tian discloses the medium bearing a deformable model in which the 
four points further include a fourth point designating a left corner of the mouth (column 9, lines 
27-28). 
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For claim 6, Tian shows the medium bearing a deformable model comprising a variable 
representing a distance between the first and second points (distance between face characteristic 
points would include distance between the first and the second points) (column 8, lines 45-48). 

Regarding claim 7, Tian further shows the medium bearing a deformable model further 
comprising a variable representing a distance between the third and the fourth points (distance 
between face characteristic points would include distance between the third and the fourth 
points) (column 8, lines 45-48). 

For claim 8, Tian teaches the medium bearing a deformable model further comprising a 
variable representing a distance between eyes and mouth (column 9, lines 25-30). 

Regarding claim 9, Tian teaches a method comprising: 

Determine a deformable model (column 11, lines 23-25) including eye positions and 
mouth positions (column 11, lines 20-25) for a frame of a digital image sequence (column 12, 
lines 10-12); and 

Estimating a subsequent deformable model include eye positions and mouth positions 
(estimates characteristic facial features points in each detected face would include mouth and 
eye positions) (column 8, lines 5-10) for a subsequent frame of the digital image sequence 
(column 9, lines 44-48 and column 10, lines 30-35) and 

Computing transformation parameters (compute the location of the salient 
landmarks/points) (column 12, lines 18-25) that represent a transformation from the deformable 
model (variability/change of shape properties of pose/expression model) (column 9, line 65 to 
column 10, line 14) for the frame to the subsequent deformable model of the subsequent frame 
(column 9, lines 44-48 and column 10, lines 30-35). 
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Referring to claim 10, Tian teaches the method wherein computing the transformation 
parameters (compute the location of the salient landmarks/points) (column 12, lines 18-25) 
includes determining optimal values for the transformation parameters such that the value of an 
objective function based on the transformation parameters is minimized (eliminates complicated 
degree of freedom/normalization) (column 10, lines 10-14 and column 12, lines 40-55). 

For claim 11, Tian further teaches the method in which the eye positions and the mouth 
positions are represented by four points defined by x and y coordinates (column 13, lines 1-4; 
FIG. 5B and FIG. 6). 

Regarding claims 12-15, Tian teaches the method which the four points comprise a first 
point, second point, third point and fourth point to designate left eye center, right eye center, left 
mouth, and right mouth and uses labeling technique as Pn (PI, P2, P3 and P4) to label each point 
(FIG. 5B). Tian does not explicitly use the labeling system i = 1, i = 2, i = 3, and i = 4. 
However, it would have been obvious to use also use Pn system or I = n system to label each 
region of the image for better recognition each region of the image in order to help the system to 
automatically label facial expressions and facilitating retrieval base on facial expressions 
(column 7, lines 60-64). This would improve processing and therefore, it would have been 
obvious to one of the ordinary skill in the art to modify Tian to implement a labeling method. 

Regarding claim 16, Tian teaches the method in which the four points of the subsequent 
deformable model (column 9, lines 44-48 and column 10, lines 30-35) are determined by six 
parameters (distance's parameters and histogram's parameters) (column 13, lines 20-44) and the 
deformable model (column 13, lines 45-47). 

Referring to claim 17, Tian teaches the method of in which the six parameters comprise: 
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a first parameter representing a distance increase between eyes (distance between left and 
right eyes) (column 12, lines 60-67); 

a second parameter representing a distance increase between eyes and mouth (column 13, 
lines 25-28); 

a third parameter representing a distance increase between mouth corners (column 13, 
lines 30-33); 

a fourth parameter representing a rotation angle (column 13, lines 60-67); 

a fifth parameter representing a shift value along an X axis (L or N) (FIG. 6); 

a sixth parameter representing a shift value along a Y axis (M or K) (FIG. 6). 

Regarding claim 18, please refer back to claim 9 for further teachings and explanations. 
In addition, Tian teaches a computer program product comprises instruction stored on a 
computer-readable storage device (column 7, lines 57-60 and column 9, lines 49-50) to perform 
the aforementioned limitations. 

For claims 19-20, please refer back to claims 10-11 respectively for further teachings and 
explanations. 

For claims 21-24, please refer back to claims 12-15 respectively for further teachings and 
explanations. 

Regarding claim 25, Tian teaches the product in which the four points (FIG. 9, element 
905) of the subsequent deformable model (column 9, lines 45-48 and column 1, lines 23-25) are 
determined, at least in part, based on six parameters (distances) (column 15, lines 1-21). 

For claim 26, please refer back to claim 17 for further teachings and explanations. 

For claim 27, as discussed in claim 9, Tian teaches a method comprising: 
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Receiving a first digital image in a sequence of digital images (FIG. 4, element 410) and 
eye and mouth coordinates (FIG. 5B); 

Outputting (column 12, lines 5-10) eye and mouth coordinates on a subsequent digital 
image in the sequence of digital images (FIG. 6). 

For claim 28, Tian further teaches the method in which receiving further comprises 
estimating a base face model and the base face model's transformation parameters T* by the eye 
and mouth coordinates (transform characteristic points of a face would include transformation 
parameters of the eye and the mouth coordinates) (column 12, lines 40-56). 

Regarding claim 29, Tian also teaches the method in which outputting comprises: 

Calculating an initial model M as a transformed base model M b using transformation 
parameters T (that is the concept of transformation process) (column 5, lines 34-38 and column 
12, lines 55-56); 

Rotating the subsequent image to I(x, y) to generate a normalized model M (column 13, 
line 55 to column 14, line 8). 

Allowable Subject Matter 
7. Claims 30-32 are objected to as being dependent upon a rejected base claim, but would 
be allowable if rewritten in independent form including all of the limitations of the base claim 
and any intervening claims and overcome the objection of the claims. 
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Conclusion 

8. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Brian Q. Le whose telephone number is 571-272-7424. The 
examiner can normally be reached on 8:30 A.M - 5:30 P.M. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew Bella can be reached on 571-272-7778. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 




Brian Le 
June 5, 2007 



